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This paper concerns iterative methods for solving boundary value prob- 
lems for systems of nonlinear partial differential equations. The methods 
involve subtracting an average of residuals from one approximation in order 
to arrive at a subsequent approximation. 

The paper is divided into five parts. The first part gives two ab- 
stract methods in Hilbert space. The second part shows how to apply these 
methods to quasilinear systems to give numerical schemes for such problems. 

The third section contains some specific applications. The fourth part con- 
tains a discussion of some potential theoretic matters related to the iteration 
schemes. The final part indicates work in progress concerning extensions and 
improvements of the above. 


1. Two abstract iterative schemes. Suppose H is a Hilbert space, H^ a 
closed subspace of H and P is an orthogonal projection on H whose range is a 
subset of H'. Suppose also that L is a strongly continuous function from H to 
L(H,H) so that L(U) is an orthogonal projection for each U in H. It will be 
seen how a variety of boundary value problems for nonlinear systems may be re- 
duced to the problem of finding U6H^ so that 

(1) L(U)U=0, P(U-W)=U-VJ 

where W is a given element of H^ . It will be seen that the first part of (1) 
represents a quasilinear system and the second part of (1) is a way of as- 
serting that U satisfies boundary conditions described by the given element W. 

For 6>0 an iterative scheme for attempting to find U satisfying (1) is 

(2) Wn =W, W ^ = W - 6PL(W )W ,n = 0 ,1 , 2 , . . . . 

n+1 n n n 

r ~oo . 

If converges to U^H , then 

(3) P(U-W) =U-W and PL(U)U = 0. 

A solution U to (3) is called a quasisolution to the problem (1). See ref. 1 
for a discussion concerning quasisolutions vs. actual solutions. 

A second scheme uses a continuous iteration parameter but is otherwise 
similar to (2): Define Z H so that 

(4) Z(0) =W,Z' (t) =-PL(Z (t))Z (t) , tS:0. 

If U = lim Z (t) exists, then U satisfies (3). 

t->«) 
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For numerical schemes one is interested in finite dimensional choices 
for (2) under fairly unrestrictive hypothesis on P and L. In ref. 2 it is 
shown that (2) always 'converges in the linear (L(x) independent of xCH) for 
6=1* Similar results may be obtained for (4) by noting that (4) is a lim- 
iting case of (2) as 6 ->0. 

2. Quasilinear systems; use of finite differences. It is first indi- 
cated how a fairly general second order quasilinear system may be placed in a 
setting to which the iterative schemes (2) , (4) apply. Extensive generali- 
zations will be evident. 

Suppose ^2 is a bounded open subset of and each of R,S,T is a contin- 
uous real-valued function on R^. Functions z,u,v on Q are sought so that 

|R(z,u,v)ui + S(z,u,v) (u 2 + vj) + T(z,u,v)v 2 =0 

(5) /zi-u = 0 
Iz2 - V = 0 

where ui = 6u/6x, U 2 = 6u/6y etc. 

If appropriate derivatives exist and (5) holds, then 

(6) R(z,Zi,Z2)zii + 2S(z,Zi,Z2)zi2 + T(z,Zi,Z2 )z22 = 0 . 

Pick two piecewise smooth one-dimensional curves T and F' in and a 
function W€ C ( $^) - Consider boundary conditions for (5) : 


z(p) = w(p) ,p€ r 


(7) 


u(p)'\ = /?Wi(p)'\ /f(p) 


/uCp)"! 

Vv(pV ’ 


Vg(p)// 


W2(P)/ ’ \g(p), 


, P€T 


(g(p)) 


denotes the direction normal to T* at p. 

Define A:R^ ->L(R^ ,R^) modeled on (5) so that 

A(r,s,t) (a,ai,a 2 ,b,bi,b 2 ,c,ci,C 2 ) = 

^(r,s,t)bi +S(r,s,t) (b 2 + ci) +T(r,s,t)c 2 
aj^ - b 
32 - c 

(r,s,t) , (a, 3] ,32) , (b,bi,b 2 > , (c,ci ,C 2 >€ R^ . 

Note that if z ,u,v€ and 

A(z(p) ,u(p) ,v(p)) 

(z(p) ,zi(p) ,Z 2 (p) ,u(p) ,ui(p) ,.U 2 (p) ,v(p) ,vi(p) ,V 2 (p))= 0, 

then z,u,v satisfy (5). 
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Denote L2(fi)® by H, denote by H' the set of all (z,z' ,u,u' ,v,v') €H 
where z^ = (zx»Z2) etc. and all indicated derivatives are L2 generalized deri- 
vatives (cf ref. 3 ). Denote by Hq the set of all (z,z^ ,u,u' ,v,v^) €H ' so that 

z(p) =0, p€ r 

4^(P)) , (g(p)))“°’P^^' 

and denote by P the orthogonal projection of H onto Hq • 

To complete a description of how (5), (7) are carried over to (1) a de- 
scription of L is required. Denote L 2 (^^ by K and define C:H-)-L(H,K) so that 
if U,Z€H, then for almost all p€ , 

(C(U)Z)(p) = (A(q)A(q)*)"^A(q)'zi(p) 

where q = (r,s,t) and r,s,t are the first, fourth and seventh elements respec- 
tively of U(p). Finally for D€H, L(U) eC(U)*C(U). 

For w as above, define W=(w,wi,W 2 ). Start iteration (2) with W. Then 
for n = 0,1,2, has the property that the triple consisting of the first, 

fourth and seventh elements of W satisfy (7). Similar statements hold for the 
iteration (4) . ^ 

It is now indicated how a finite difference scheme for (5) , (7) may be 
constructed by defining finite dimensional spaces H and K which approximate H 
and K a^ve. Suppose Gq is a rectangular grid with even spacing 6 so that 
G E Gq P] has the property that if p€G, then at least one of p + 6e. is in 
G,i=l,2, where ei,e 2 is the standard basis for R^. Define K to be a vector 
space of all real-valued functions on the grid G. For u6K, define 

{ (u(p + 6e^)-u(p-6e^))/(26) if p + (Se^,p-(Se^€ G 
(u(p + 6e^)-u(p))/6 if p-6e^ ^G 
(u(p)-u(p-(Se^)) /6 if p + 6e^ ^G, i = l,2, pGG. 

Define H=K^. For (z,u,v)EK^, define 

D(z,u,v) = (z,Diz,D 2 Z,u,Diu,D 2 U,v,Div,D 2 v) . Denote by H' the range of D. 

Define subsets of G approximating Y and r' respectively. Denote by 

the set of all D(z,u,v)GH' such that 


( 8 ) 


z(p) =0, p€£ 



Denote by the orthogonal projection of H onto . 
mating w above. Define ^ = w, ^ = Di_w, v = D 2 W and choose 
Wq = (z,Dt z ,D9 z ,u,Di u,D9U,v,Di v,Ib v) and 


( 9 ) 


W =W -PL(W )W ,n=0,l,2, 
-n + 1 -n -n'-n * ’ 


Pick w6K approxi- 
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where L is defined essentially as above. Condition (8) on ^ implies that 
boundary conditions are preserved under the iteration (9) and hence are sat- 
sified by a limit of fW 

Similar statements hold for a finite dimensional counterpart to the 
iteration (4) . 

Process (4) in this finite dimensional setting becomes a variant of the 
“method of lines". It specifies one equation and one ’unknown’ for each point 
in the grid G. The ’time’ parameter is iteration number, not a distinguished 
variable in the system of differential equations. Use of (4) then may extend 
the use of the ’method of lines’ to a larger class of problems. 

3. Applications. 

Take to be a bounded region in R^. Define R,S,T in (5) so that 

R(z,u,v) = 1 + v^ 

S(z ,u,v) = - uv 
T(z ,u,v) = 1 + u^. 

System (5) then is 

(1 + v^)ui - uv(u2 + vj) + (1 4* u^)v^ = 0 
zi - u = 0 
Z2 - V = 0 

As a single second order equation this is 

(l + z^)zii- 2ziZ2Zi2+ (1+ Z22 = 0, 

the minimal surface equation for real-valued functions on a region in R^. 
Conditions are specified by 


z(p) = f (p) ,pG 3 

for some given function f. The FORTRAN code listed in ref. 4 may be easily 
modified to deal with this equation. 

If y,a^,u^ are given positive numbers and R,S,T are chosen so that 

R(z,u,v) = a^+ ((Y~1)/2) (u^-u^-v^) - u^ 

S (z ,u,v) = -uv 

T(z,u,v) = a^+ ((y-l)/2(u^-u^-v^) - v^ 

then (5) reduces to the transonic flow equation used in reference 4 (and 
taken from reference 5). For numerical computations, boundary conditions at 
infinity are replaced by appropriate boundary conditions on the boundary of a 
large box. One also has zero normal derivative conditions on an airfoil inside 
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the box. See references 4,5 for details. The FORTRAN listing in reference 4 
is specifically for this problem. Printouts of results for various mach num- 
bers (u^/a^) are given there. 

4. Finite dimensional potential theory. The main computational effort 
connected with (9) is the calculation of Px for various x^H. Denote by 

all (z,u,v)6K^ satisfying (8) and denote by tt the orthogonal projection of 
onto Jq. From ref. 2 it follows that P=DE^^ttD* where E = 7 tD*D I _ . Hence 

lo 

the main work in calculating the action of ^ is the solving for x (given y) 
in linear systems 

(10) Ex = y. 

Now ^0 is a Dirichlet space in the sense of ref. 6 and E is the corresponding 
Laplacian for being the inverse of a Laplacian, the effect of 

multiplying a vector y by E~^ is to take a certain nonnegative weighted aver- 
age of the components of y. References 2 and 4 contain descriptions of methods 
for solving (10) . 

5. Extensions and Improvements, 

A promising replacement for (4) is given by 

(11) z(0) =wz'(t) =-(V(j)) (z(t)) , t^O 

where a(x) =% [[ A(x)x]|^,x€H , A being defined as in section 3. One has the 
following explicit expression for the gradient of <^: 

(V(f>) (x) = P[A(x) * + C(x) *] A (x)x, x€H. 

Then (11) becomes a steepest descent process. In a number of examples, the 
only critical points of seem to be solutions to (3) . Furthermore, solutions 
z to (3) remain bounded and so converge to a solution u to (3). 

Work is in progress concerning the adaptation of (2) , (4) and (11) to 
finite element spaces rather than finite difference schemes. It is expected 
that methods will be developed which use finite element spaces but have little 
else in common with conventional finite element methods. See reference 7 for 
some preliminary results. 
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